Видео с ютуба Moe Cache

Внутри llama.cpp: как запускать огромные MoE-модели (новый кэш экспертов)

llama.cpp PR #29887: GPU Cache for MoE Experts

Worst clutch in the history of CS by mOE

The LRU Cache That Doubled Local MoE Speeds: llama.cpp Expert Offloading

llama.cpp PR #30637: SLRU Cache for MoE Models

My local AI 70% faster with llama.cpp (RTX 5060 8 GB, new MoE cache)

llama.cpp's New MoE Expert Cache: Up To 2.2x Faster on One GPU

Your MoE Model Is 2× Slower Without This llama.cpp Flag

Run 125B Models on 8GB Ram: llama.cpp Expert Cache

The MoE Trap: Why 3B Active Doesn't Mean 3GB of VRAM (Qwen 35B)

llama.cpp Just Made Huge MoE Models 4× Faster

llama.cpp's MoE Cache: 3x On 16GB. Off By Default.

How KV Cache Speeds Up LLMs for Faster AI Models on GPUs

Визуальное руководство по составу экспертов в программах магистратуры по праву.

В llama.cpp добавили Expert Cache... Победит ли он Strata на 12 ГБ?!

Mon IA locale 70 % plus rapide avec llama.cpp (RTX 5060 8 Go, nouveau cache MoE)

llama.cpp Just Got an Expert Cache. Do You Still Need Strata?

llama.cpp Just Made 125B MoE Models 4× Faster!

Broken in 12 Days: How a 1993 Idea Fixed llama.cpp MoE Caching